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APPARATUS AND METHOD FOR REMOTELY OPERATING A PLURALITY 
OF INFORMATION DEVICES CONNECTED TO A NETWORK PROVIDED 
WITH PLUG-AND-PLAY FUNCTION 
BACKGROUND OF THE INVENTION 
5 Field of the Invention 

The present invention relates to a network control 
apparatus for controlling operations of peripheral 
devices and a remote operation device for displaying 
statuses of the peripheral devices and remotely 
10 operating the peripheral devices in an environment for 
using the peripheral devices connected to a network 
constructed in the home, office or the like. 



Description of the Related Art 

15 In recent years, with techniques using the internet 

progressing remarkably, the internet has been widely 
spread in not only companies, but also in general homes. 
The internet is mainly used for e-mail, internet shopping, 
internet telephone and Web search in the homes. Then 

20 it becomes familiar also to the homes to connect a 
plurality of personal computers and peripheral devices 
such as a printer as a network to share. This technique 
is achieved by blending and combining, for example, 
services provided from an internet provider, technique 

25 of networks including Ethernet, internet protocol (IP), 
and OS of personal computer. 

Meanwhile, there is proposed an attempt to connect 



electric devices (devices to be operated) such as a 
scanner, digital TV, and refrigerator to a home network 
to collectively control a lot of electric products 
(so-called information home electric appliances) 
existing in the home. 

However, most of products connected to the home 
network to be operated do not have IP addresses. Hence 
it is impossible to transmit data using the internet from 
a remote place to the products connected to the home 
network to be operated such as a digital TV . 

Further, it is possible to handle most of the 
products connected to the home network to be operated 
only using data format dedicated to the corresponding 
electric products, and therefore such products require 
particular conversion processing. For example, when a 
color image showed on a digital TV is output to a color 
printer, it is necessary to convert the RGB data format 
into the CMYK data format. 

Further, there is a problem on the operability of 
products to be operated besides the above-mentioned 
problems on the IP address and data format. Man-machine 
interfaces provided on preexisting products to be 
operated are particularly limited, and therefore it is 
necessary to greatly change the man-machine interfaces 
of the products to be operated to use the products in 
operative connection with others on a network. 



SUMMARY OF THE INVENTION 
The present invention was carried out in view of 
the foregoing. It is an object of the present invention 
to provide an apparatus for greatly improving the 
operability of products connected to a home network to 
be operated in using the products on the network, without 
changing the man-machine interfaces of the products to 
be operated. 

It is an another object of the present invention 
to provide a remote display device enabling improved 
operability of the products connected to the home network 
to be operated in using the products on the network. 

In the present invention, when the remote display 
device is connected to the home network, a home network 
control apparatus receives a request from the remote 
display device, shows a display to operate the products 
to be operated and controls the products to be operated 
according to inputs on the operation from the remote 
display device. 

It is thereby possible to achieve the improved 
operability without changing the man-machine interfaces 
of the preexisting peripheral devices. 

BRIEF DESCRIPTION OF THE DRAWINGS 
The above and other objects and features of the 
invention will appear more fully hereinafter from a 
consideration of the following description taken in 



connection with the accompanying drawing wherein one 
example is illustrated by way of example, in which; 

FIG. 1 is a system construction diagram illustrating 
a situation that home network control apparatuses are 
used according to one embodiment of the present 
invention ; 

FIG. 2 is a functional block diagram of the home 
network control apparatus according to the above 
embodiment ; 

FIG. 3 is a management table of the home network 
control apparatus according to the above embodiment; 

FIG. 4 is a flow diagram of processing in the home 
network control apparatus when a remote display device 
is connected to a home network according to the above 
embodiment ; 

FIG. 5 is a structural diagram of an initial 
operation display showed on the remote display device; 

FIG. 6 is a structural diagram of an input display 
showed on the remote display device; 

FIG. 7 is a structural diagram of a status displaying 
display showed on the remote display device; 

FIG. 8 is a flow diagram illustrating a first half 
of receiving processing in the home network control 
apparatus according to the above embodiment; and 

FIG. 9 is a flow diagram illustrating a latter half 
of the receiving processing in the home network control 
apparatus according to the above embodiment. 



DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENTS 
An embodiment of the present invention will be 
described specifically below with reference to 
accompanying drawings. 

FIG.l is a diagram illustrating a situation that 
home network control apparatuses are used according to 
the present invention. It is constructed that home 
information networks provided in homes A and B are capable 
of accessing to the internet 101 via internet service 
providers 102a and 102b respectively. 

Each home network control apparatus 103 connects 
a respective home information network with internet 
service provider 102a (102b). Home network control 
apparatus 103 is connected in parallel to serial bus 
network 104 conforming to IEEE 1394 (hereinafter 
referred to as IEEE 1394 network) and Ethernet 106. 

IEEE 1394 network 104 connects various peripheral 
devices 105 that are not able to access to the internet 
by themselves. Peripheral devices 105 are capable of 
connecting to IEEE 1394 network 104 easily by connecting 
to an IEEE 1394 hub. In the present invention, remote 
display device 108 is connected to the above-mentioned 
IEEE 1394 hub as one of peripheral devices 105. 

It is assumed that Ethernet 106 connects personal 
computer 107 and other peripheral devices that have 



respective IP addresses. In addition, some information 
home electric appliances connected to Ethernet 106 are 
not able to access to the internet by themselves. 

Thus, various information devices (such as a 
personal computer, printer, scanner, digital TV, digital 
camera, refrigerator, hot-water supply system, electric 
power meter, and tap water meter) existing in home A or 
B are combined as a home information network using home 
network control apparatus 103, Ethernet 106, and IEEE 
1394 network 104. 

Although the home information network includes 
peripheral devices that are not able to communicate 
through the internet, home network control apparatus 103 
enables the peripheral devices to communicate through 
the internet. 

FIG. 2 illustrates a functional block diagram of 
home network control apparatus 103. 

System control section 201 is comprised of a CPU 
and controls the entire operation of home network control 
apparatus 103. System control section 201 communicates 
data with each section in the apparatus through internal 
bus 202. 

Application converting section 203 are comprised 
of a plurality of pieces of software prepared 
corresponding to respective applications (data formats) 
of the peripheral devices. The software of each device 
operates to convert data received from another device 



into data with format enabling the device to handle the 
data . 

Operation control processing section 204 receives 
an operation request from display section 105a provided 
in peripheral apparatus 105 and remote display device 
108, while outputting an operation display instructed 
from system control section 201 to display section 105a 
or remote display device 108. The section 204 performs 
processing such as GUI processing of a display showed 
on display section 105a or remote display device 108. 

Outside connection communication section 205 
performs protocol processing to communicate with an 
external network (out of home) through a communication 
medium such as the internet, ISDN and ADSL. For example, 
when a communication using the internet is performed, 
an internet protocol is executed. 

Home network communication section 206 controls 
media of IEEE 1394 network 104 and Ethernet 106 composing 
the home information network. Home network 

communication section 206 controls communications 
between peripheral devices 105 connected to the home 
information network and home network control apparatus 
103 (including data transmission between the peripheral 
devices 105 via home network control apparatus 103). 

First memory section 207 is comprised of a RAM and 
is a work area for use in writing and reading data by 
application software started by system control section 
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201 . 

IP processing section 208 provides functions for 
identifying and converting an IP address. IP processing 
section 208 identifies a type of IP address (IPv4 or IPv6) 
contained in a destination of received data, and adds 
a destination IP address to transmission data. Further, 
the section 208 converts an address system of IP address 
when necessary. For example, the section 208 converts 
an address system of IPv6 into that of IPv4. 

Memory control section 209 controls second memory 
section 210 to control write and read of data. Second 
memory section 210 is used to store a program and 
temporarily store data. 

Security managing section 211 protects an improper 
access to the home network through the internet, using 
a password. 

Management table 212 manages IP addresses assigned 
to all the peripheral devices including virtual IP 
addresses used on the home information network. In the 
present invention, the virtual IP addresses are assigned 
to peripheral devices (hereinafter referred to as non-IP 
peripheral devices) that generally do not access to the 
internet by themselves to communicate and therefore 
originally do not have an IP address, such as a digital 
camera, scanner and printer among the peripheral 
devices . 

As shown in FIG. 3, management table 212 controls 
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IEEE 1394 node ID 301, unique ID 303, device attribute 
304 and application type 305 each in relation to IP 
address 302 of each device. Node ID 301 is a device 
number assigned to each terminal on the IEEE 1394 network. 
5 On the IEEE 1394 network, a device is assigned the node 
ID automatically at the time of connecting to the network, 
while being assigned a new node ID using a predetermined 
algorithm at the time of bus reset, and therefore there 
is a possibility that the node ID changes as the time 

10 elapses. Unique ID 303 is an identification number 
inherently assigned to the device existing on the IEEE 
1394 network, and does not change. Device attribute 304 
is indicative of a function attribute of the device 
existing on the IEEE 1394 network. Specifically, device 

15 attribute 304 has information that enables recognition 
of a product (such as camera, television or printer) and 
function (such as CCD, digital or color) of a CCD camera, 
digital TV, scanner, color printer or the like. 
Application type 305 has a number of an application to 

20 be converted to be adapted to a designated device. 
Management table 212 has remote display device 108 
registered therewith as one of the peripheral devices 
connected to IEEE 1394 network 104. 

Referring to above-mentioned management table 212 

25 enables a communication partner to be recognized 
successively even when the node ID is re-assigned 
automatically at the time the plug-and-play function 
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operates based on the IEEE 1394, and is different from 
a previous node ID. Further, by starting an application 
of a device to be used using the IP address, it is possible 
to perform application conversion service via the 
5 internet between the IEEE 1394 devices, between Ethernet 
devices and between a combination of the devices. 

A specific explanation is next given of the contents 
of operations of the home network control apparatus using 
remote display device 108. 

10 IEEE 1394 network 104 easily expands the number of 

connected peripheral devices by using IEEE 1394 hub 213. 
Meanwhile, among devices installed in the home, there 
are a small number of devices such as a copier that operate 
independently to complete the operation thereof, and are 

15 a large number of devices that operate with another 
device(s) to complete a desired operation such as 
printing that is performed by a scanner and a printer. 

In this embodiment, remote display device 108 is 
connected to IEEE 1394 hub 213 existing in the vicinity 

20 of peripheral devices 105 to be used, and a user operates 
peripheral devices 105 using remote display device 108. 
For example, a case is assumed that an original is scanned 
with a scanner that is one of the peripheral devices 
connected to IEEE 1394 network 104 and the scanned image 

25 is printed out from a printer that is also one of the 
peripheral devices connected to IEEE 1394 network 104. 
While various settings for the printer cannot be 
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performed conventionally except using a PC having an 
installed printer driver, the settings are performed 
with home network control apparatus 103 through remote 
display device 108 instead of the PC in the present 
5 invention. 

FIG. 4 is a flow diagram illustrating processing 
performed in home network control apparatus 103 by 
connecting remote display device 108 to IEEE 1394 network 
104. When remote display device 108 is connected to IEEE 
10 1394 hub 213, the node IDs assigned previously are reset 
once, and new node IDs are assigned to peripheral devices 
including remote display device 108. 

When remote display device 108 is newly included 
in the peripheral devices assigned the node ID, system 
15 control section 201 judges that remote display device 
108 is connected to IEEE 1394 network 104 (ST40). 

When remote display device 108 is connected, 
operation control processing section 204 generates an 
initial operation display for displaying icons of 
20 peripheral devices that needs support of remote display 
device 108 to operate. FIG. 5 illustrates a structural 
example of the initial operation display. The display 
includes character sequences for an operation guidance 
to a user as well as icons of the peripheral devices. 
25 Home network communication section 206 transmits data 
on the initial operation display generated by operation 
control processing section 204 to IEEE 1394 network 104. 
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Remote display device 108 fetches data having the node 
ID thereof from a data stream, thereby fetches the data 
on the initial operation display from the network, and 
shows the display shown in FIG. 5 on a display section. 
5 A user selects a device to operate from the initial 

operation display using the operation section of remote 
display device 108. Selected data is transmitted from 
remote display device 108 to IEEE 1394 network 104. 

In home network control apparatus 103, home network 

10 communication section 206 fetches data having the node 
ID thereof from the data stream of the network. When the 
section 206 fetches the data on the selected device 
transmitted from remote display device 108, the section 
206 determines the contents of operations based on the 

15 data on the selected device (ST42). For example, when 
a scanner and a specific printer are selected on the 
initial operation display, it is judged that the contents 
of operations are indicative of scanning an original with 
the scanner and of printing the original with the printer. 

20 It is assumed that expected contents of operations are 
made in the form of a pattern in advance corresponding 
to a combination of icons (peripheral devices). 

In addition, there is a case that the contents of 
operations are not determined with the display showed 

25 once. In this case, showing the display and receiving 
the data on selection are repeated some times. 

Further it may be possible to analyze a character 



13 



sequence input from the operation section of remote 
display device 108 to judge the contents of operations, 
or to provide the operation section with function keys 
to judge the contents of operations corresponding to a 
5 pressed function key, instead of determining the 
contents of operations only with a selected icon. 

It is assumed herein that a scanner and a laser 
printer are selected on the initial operation display. 
In this case, it is necessary to instruct the laser 

10 printer of the number of sheets to print. The apparatus 
103 judges that this case needs data input (ST43), 
generates data on an input display for requesting a user 
to input data, and transmits the data on the input display 
to remote display device 108 to display the input display 

15 (ST44). FIG. 6 illustrates an input display for use in 
instructing the laser printer of the number of sheets 
to print. 

For example, when a user selects the number of 
sheets to copy on the input display (FIG. 6) showed on 

20 remote display device 108 and presses a confirmation 
button, the input data is added the node ID of home network 
control apparatus 103 and transmitted to the network. 

Home network control apparatus 103 acquires the 
input data transmitted from remote display device 108 

25 from the network {ST45). The apparatus 103 determines 
whether application conversion is required 

corresponding to the contents of operation determined 
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at step ST42 (ST46). When the data conversion is 
required, system control section 201 instructs 
application converting section 203 to start up 
corresponding software (ST47). Based on the node ID or 
5 UID of the device to be operated (laser printer), the 
section 201 fetches an application type of the laser 
printer from management table 212, and acquires a 
software number to convert data format to be adapted to 
the laser printer. Thus acquired software number is 

10 notified to application converting section 203. 

Meanwhile, image data scanned with the scanner 
operated by the user is transmitted from the scanner to 
home network control apparatus 103. Home network 
control apparatus 103 stores the image data received from 

15 the scanner in first memory section 207. 

Then, the software started by application 
converting section 203 reads the image data from first 
memory section 207 , and converts the image data into data 
with format adapted to the laser printer (ST48). 

20 Specifically, printer software generates descriptor 
text required for the printer, and writes again the text 
in first memory section 207. 

Next, system control section 201 provides the image 
data converted into PDL to home network communication 

25 section 206 to transmit to the network with a designated 
output destination indicative of the laser printer that 
is previously selected {ST49). 
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The laser printer fetches the data addressed to the 
printer from IEEE 1394 network 104, and is thus capable 
of printing out the data. 

Meanwhile, when home network control apparatus 103 
5 judges that the data input is not necessary at 
above-mentioned step ST43, the processing flow shifts 
to ST140, and the section 103 judges whether or not a 
request is made for displaying a status of the device 
to be operated. When the request is made for displaying 
10 the status of the device to be operated at ST42, the 
apparatus 103 collects information on the device to be 
operated based on, for example, control information 
stored in management table 212 and first memory section 
207 (ST141 ) . 

15 For example, it is assumed that the apparatus 103 

receives from remote display device 108 a request for 
displaying a status of a digital TV that is a peripheral 
device on IEEE 1394 network 104 of home A, and that data 
is received via the internet from home B with a 

20 destination indicative of the digital TV of home A. 

In this case, the device to be operated is turned 
off or is not connected to the network when the device 
is not assigned the node ID, and therefore home network 
control apparatus 103 generates a status display 

25 comprised of a message for instructing a user to turn 
on the device. Further, when the apparatus 103 detects 
that received data with a destination indicative of the 
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digital TV is stored in first memory section 207, the 
apparatus 103 adds another message for notifying the user 
of the received data to be reproduced to the status 
display. Then, the apparatus 103 transmits the data on 
5 the generated status display to remote display device 
108 (ST142). As a result, remote display device 108 
shows information on the device to be operated. FIG. 7 
illustrates an example of a display showed when a digital 
TV is selected as a device to be operated of which the 

10 status should be showed. 

When the user turns on the digital TV and inputs 
that the power supply is completed from remote display 
device 108, the received data stored in first memory 
section 207 is output to the digital TV based on the IEEE 

15 1394. The received data output based on the IEEE 1394 
is already converted with software started by 
application converting section 203 to have a data format 
enabling the digital TV to display the data, and thereby 
the digital TV is capable of displaying the received data. 

20 A next explanation is given of the operation when 

home network control apparatus 103 receives data via the 
internet. The explanation below describes a case that 
a non-IP peripheral device on IEEE 1394 network 104 of 
home A transmits data to a non-IP peripheral device on 

25 IEEE 1394 network 104 of home B- 

FIGs.8 and 9 illustrate a flowchart such that home 
network control apparatus 103 of home B as a receiving 
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side provides data received from internet service 
provider 102b to non-IP peripheral apparatus 105 to 
complete the processing. 

In home network control apparatus 103 of home B as 
5 the receiving side, outside connection communication 
section 205 operates to access to internet service 
provider 102b, and acquires data addressed to the home 
B (ST51 and ST52). The section 205 fetches as the data 
addressed to home B data having as a designation address 

10 an IP address according with the IP address registered 
with management table 212 installed in home network 
control apparatus 103. 

IP processing section 208 checks the IP address of 
the fetched received data to identify a type of the IP 

15 address (ST53). Specifically, the section 208 

identifies whether the IP address is of IPv4 or of IPv6. 

When the section 208 judges at step ST53 that an 
IPv4 peripheral device is designated with an IPv6 address, 
the IPv6 address is converted into a corresponding IPv4 

20 address (ST56 and ST57) with an IP tunneling technique. 
Assume that an algorithm for converting IP addresses 
confirms to RFC of IETF, and that IP datagram is stored 
in first memory section 207. 

Next system control section 201 specifies a 

25 peripheral device having the IP address according with 
the IP address of the received data by referring to 
management table 212 (ST58, ST59 and ST60) . For example. 
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when the IP address of the received data is 133.185.245.9, 
the section 201 finds it on a column of IP address 302 
in management table 212, and according to the contents 
of the table, recognizes that the destination indicates 
5 the printer on the IEEE 1394 network. 

System control section 201 judges a device 
attribute and application type of the peripheral device 
specified with the IP address from management table 212 
(ST61). Further, when the destination indicates a 

10 non-IP peripheral device on the IEEE 1394 network, the 
section 201 concurrently acquires the node ID. 

There is a possibility depending on the received 
data that a peripheral device of the destination is not 
able to handle the received data when the data is 

15 transferred to the device as it is. It is assumed that 
the datagram stored in first memory section 207 is scanner 
data transmitted via internet 101, and therefore is not 
capable of being output to the printer directly. It is 
necessary to convert the data provided from the 

20 transmitting side into data with format enabling the 
device at the receiving side to process. As described 
above, applications for converting data into another 
data with format that respective peripheral devices are 
capable of interpreting are installed in the home network 

25 control apparatus for each peripheral device, and the 
application numbers are set in management table 212. 

System control section 210 acquires the application 
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number from management table 212, and notifies 
application converting section 203 of the application 
number, and the section 203 starts up the corresponding 
software to perform conversion processing. The data 
5 converted with the converting program is stored again 
in first memory section 207 (ST63). 

Next system control section 201 starts up a printer 
driver to convert the data into printer data (ST64). In 
order to output converted data stored in first memory 
10 section 207 , a frame confirming to IEEE 1394 is generated 
with the node ID acquired at the above-mentioned step 
ST61 as a destination (ST65). Then the frame is 
transferred to the printer on IEEE 1394 network 104 
( ST66 ) . 

15 According to this embodiment as described above, 

when remote display device 108 is connected to IEEE 1394 
network 104, home network control apparatus 103 receives 
a request from remote display device 108, shows a display 
for use in operating a device to be operated on remote 

20 display device 108, and controls the device to be operated 
according to a desired operation input from remote 
display device 108, whereby it is possible to achieve 
high operability without changing man-machine 
interfaces of preexisting peripheral devices. 

25 Further, when peripheral devices have different 

applications, an application type of a device to be 
operated is recognized from management table 212 and data 
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is converted into another data with format adapted to 
the device to be operated as an output destination, 
whereby it is possible to communicate data between 
devices with different data formats. 
5 Furthermore, management table 212 manages node IDs 

301, device attributes 304, and application types 305 
based on IP addresses of non-IP peripheral devices, the 
non-IP peripheral devices that are not capable of 
directly connecting to the internet conventionally are 

10 capable of receiving service supply via the internet such 
as information retrieval, information collection and 
e-mail, and the use of applications is made possible to 
operate devices connected to different home electric 
appliances networks via the internet. 

15 In addition, while in this embodiment as described 

above all the peripheral devices are showed on the initial 
operation display, it may be possible to limit peripheral 
devices to be showed to some of them in advance according 
to each condition. For example, a connected peripheral 

20 device may be specified that exists in the vicinity of 
remote display device 108 based on a network structure 
of IEEE 1394 network 104, and devices related to the 
contents of operations that the specified device is 
capable of performing may be showed. For example, while 

25 all the printers (three) are showed on the initial 
operation display illustrated in FIG. 5, the display may 
be composed so that printers except a laser printer are 



not showed when remote display device 108 is connected 
to the laser printer existing in the vicinity of the 
device 108. The number of peripheral devices to be 
showed on the initial operation display is thereby 
reduced, and therefore it is possible to prevent the 
occurrence of wrong selection and to improve the 
operability . 

Further the remote display device may be provided 
with a browser function, and the home network control 
apparatus may be provided with a function of a WWW server 
for storing files to achieve the above-mentioned 
operation contents. Then, data may be communicated 
between the remote display device and the home network 
control apparatus using xML text (structured text such 
as HTML). Furthermore, the home network is not limited 
to IEEE 1394 network and Ethernet. For example, it may 
be possible to apply, for example, a home network 
architecture using telephone lines, and home RF such as 
Blue Tooth that is a short-distance wireless standard. 



